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A Turing Machine solves 
one problem 


* We must distinguish 
between 


- The set of all strings 
- A problem (e.g. the 
language to be accepted 
- A problem instance (e.g. a 
word from the language 
* А ТМ solves each instance 
presented as input 
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First computers: custom 
computing machines 


Р E Input tape (read only) 
= [ITIITIIITIII] 


LITT НП 
Control Work tape (memor 
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Output tape (write only) 
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ano, 
t 


(аит — Em ` s 
1950 -- Eniac: the control 
is hardwired manually for 
each problem. 
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TMs can be described 


Input tape (read only) 
LIITT] 


СТТ 


Work tape (memo 


LITIIIIIIITI 
Output tape (write only) 


‘Consequence: 
: There is a countable number of Turing 
03/0372 Machines 


There is a TM which can 
simulate any other TM 


Output tape 


Interpreter 
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The Digital Computer: a 


Machine 


Machine-code Interpreter 
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Random Access Memories 


Address 
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Turing machines as 


Output word 


A function f is a computable function if a 
TM with word w as input halts with f(w) as output. 
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Computable functions 


* Many functions encountered in everyday 
life are computable: 
- Addition : binary strings * binary strings -» binary 
strings 
- Sort: sequence of strings -» sequence of strings 


- Roots : polynomial -» sequence of integer roots [pg 
144] 


*ATM which decides a language computes a 
function from the set of all words to 1y,nj 


* There are many uncomputable functions: 
- |funs : N -> N| = uncountable 
- [TMs| = countable 
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Compilers: computable 
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Multiple levels of 
virtualization 


Ex: running a BASIC interpreter written in Java 
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The operating system: 
another (multi-tape) 
universal turing machine 


CPU 
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The operating system = 
dovetailing 


Ve used this technology in the proof of the last 
heorem during the last lecture: 
"heorem: Г is decidable if and only if 
L and ~L are recognizable. 
Proof: execute in parallel recognizers for Land ~L 
and stop when the first stops. 


CPU 
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Reconfigurable Hardware 


Interconnection 
network 


Em и ‚ 
7 Universal gates 


L i and/or 


= s “Storage elements 
Е 


p 


WT. 


Switches 


Universal gate = RAM A switch is controlled by a 1-bit RAM cell 
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Reconfigurable hardware 


Program If (a) c = 2; 
Pal 


Generate a TM for a specific problem! Back to ENIAC! 
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Custom hardware 
(configuration) 


Reductions between 
‚ lan uages 


; E* -> X*, computable 
i^ reduces L1to L2 iff 
win L1 <=> Қи) in L2 


f is called reduction. We writed,/ L2. 
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Reductions are useful 


Notice that neither L1 or L2 must be decidable. 


Theorem: if L1 <А2 and L2is decidable 
then L1 is decidable. 


Proof: If M decides L2 and N computes a reduction 
f from L1 to L2, build a TM P which on input м: 

* Computes f(w) using N 

e Runs M on f(w) 

* Outputs the result of M. 
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Using reductions to prove 
undecidability 


* Use the converse of the previous 
theerem: 
if A Band Ais undecidable, then В 
is undecidable. 

* We have seen two techniques to prove 
undecidability 
- The “diagonalization” proof 
- Reductions using this theorem. 
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Undecidability 


* We know that most problems are undecidable 

* Turing exhibited one natural undecidable 
problem: the Halting Problem (does a TM halt 
when given an input w?) 

* More than that: many important problems are 
undecidable 

* When you face a problem, you should be 
aware that it may be unsolvable: 
- You can search a solution 


- You can try to prove it has no solution (usu. by 
reduction) 


03/03/2000 FLAC: Reductions 19 


Some undecidable 


problems 
* Does the TM M accept the word w? 


* [s a mathematical statement true? 

* Does a Diofantine equation have any roots? 
* Does a TM accept a regular language? 

e Does a CFG generate all words in X*? 


* Will a parallel system of processes ever 
deadlock? 


* [s there a smaller TM implementing the same 
function? 


* Are two programs computing the same thing? 
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Compilers and 
undecidability 


The HP is about a language describing TMs 
Many other problems concerning TMs are 


undecidable 


Compilers cannot prove some properties of 


programs: 


- Does a C program access an array out of bounds? 
- Will ever a print instruction be executed? 


- Can these two pointers point to the same location? 


- Will a LISP program crash with a type error? 
- Can this memory location be garbage collected at 


some point? 


Compilers behave conservatively 
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The full-employment 
theorem for compiler- 


writers mE 
Theorem: There is no best optimizing 
compiler for a general-purpose 
language. 
Proof: by reduction to the HP. 
Theorem: For any compiler, there's a 
better one. 
Proof: we can always hardcode a 
program which doesn't terminate. 
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Research in programming 
languages 


* Contrast the decision problems for 
regular and context-free languages 
with Turing machines. 

* Research in programming languages 
tries to get the best of both worlds: 


- Languages powerful enough to express 
useful computations 


- But restricted enough to guarantee 
program properties 
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Reduction examples 


Definition: FIN = 1M | L(M) is finite } 
Theorem: 

FIN is not Turing-recognizable. 

~FIN is not Turing-recognizable. 
Proof: We will show 

—HP . «HIN 

—HP . sq«PFIN 


Notice that 
HP is Turing-recognizable 
HP is not Turing-decidable 
SO 
~HP is not Turing-recognizable. 
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A reduction from ~HP to 
FIN 


f(M x) is the description of a TM M’ which on input y: 
* Erases the input y 

* Writes x on the input tape 
e Runs М on x 

* Accepts if M halts on x 
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Reducing ~HP to FIN 


(end) 
f(M#x) is the description of a TM M’ which on input y: 
* Erases the input y 
* Writes x on the input tape 
e Runs М on x 
* accepts if M halts on x 


Notice that 
M halts on x » ШМ’) = >* 
M does not halt on x 9 L(M’) = © (finite) 


Notice that f is computable: 
f does not run M, 
f just writes down a machine M’ which calls M or 
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Part 2: Reducing ~HP to 
~FIN 


>< 


g(M#x) is the description of a ТМ M” which on input y: 
* Saves y 


* Writes x on the input tape 
e Runs M on x for |y| steps 
e Accepts if M does not halt before |y| steps 
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Reducing ~HP to ~FIN 


en | 
g(M#x) is the description of a M” which on input y: 
° Saves y 


* Writes x on the input tape 
* Runs M on x for |y| steps 
* Accepts if M does not halt before |y| steps 


M halts on x СМ”) = { y | |у| < run-time 


of М on input x } finite 
M does not halt on x М”) = >* 


Again: g is a computable function 


it just manipulates machine descriptions. 
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To remember 


* The theoretical notion of TM has 
profoundly influenced computer 
engineering 

* There are many important undecidable 
problems 

* Reductions are a tool to prove problems 
being undecidable 


(Note: we will see reductions again in 
complexity theory; we will use them to prove a 
problem is the hardest in a class of problems) 
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